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Attorney Docket No. 08305-109001 

WIDE DYNAMIC RANGE OPERATION FOR CMOS 
SENSOR WITH FREEZE-FRAME SHUTTER 

CROSS-REFERENCE TO RELATED APPLICATIONS 

This invention claims priority under 35 U.S.C. 119/120 
from provisional application serial number 60/243,898 filed 
October 26, 2000. 

TECHNICAL FIELD 

This invention relates to CMOS sensors, and more 
particularly to operating with a wide dynamic range using 
freeze-frame shutters. 

BACKGROUND 

An active pixel sensor ("APS") is a special kind of 
light sensing device. Each active pixel includes a light 
sensing element and one or more active transistors within the 
pixel itself. The active transistors amplify and buffer the 
signals generated by the light sensing elements in the pixels. 
One type of such APS devices is disclosed in U.S. Pat. No. 
5,471,515 by Fossum et al., the disclosure of which is 
incorporated herein by reference. 

There are many applications for active pixel image 
sensors, including scientific, as well as commercial and 
consumer applications. The special techniques of active pixel 
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sensing allow using a semiconductor family formation process 
which is compatible with CMOS, e.g,, NMOS. This technique 
enables the readout electronic to be integrated on the wafer 
using a similar process. The result is a high performance 
sensor with high quantum efficiency and low dark current. 

CMOS active pixel image sensors may be operated 
using a "rolling" shutter. Such a shutter operates by reading 
out each row of pixels, and then resetting that individual 
row, and then rolling to read and then reset the next row of 
pixels. Each pixel hence gets read and then reset at slightly 
different times. Hence, each pixel has a slightly different 
time of integration. Some applications, such as high-speed 
photography, may require more time consistency than is 
possible using this approach. Therefore, in these other 
applications, a frame shutter may be used. In the frame 
shutter mode, all pixels in the array have substantially 
identical integration start times and integration stop times. 

A wide dynamic range (WiDyR) technique was developed 
for CMOS sensors with a rolling shutter and is described in 
U.S. Patent No. 6,115,065, which is incorporated herein by 
reference. The WiDyR technique allows the extension of the 
intra-scene dynamic range of images by combining an image 
taken with a short exposure time with an image taken with a 
long exposure time. U.S. Patent No. 6,115,065 teaches designs 
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and operational methods to increase the dynamic range of image 
sensors and APS devices in particular by achieving more than 
one integration times for each pixel thereof. An APS system 
with more than one column-parallel signal chains for readout 
are described for maintaining a high frame rate in readout. 
Each active pixel is sampled for multiple times during a 
single frame readout, thus resulting in multiple integration 
times. The operation methods can also be used to obtain 
multiple integration times for each pixel with an APS design 
having a single column-parallel signal chain for readout. 
Furthermore, analog-to-digital conversion of high speed and 
high resolution can be implemented. 

SIJHMARY 

Wide dynamic range operation is used to write a 
signal in a freeze-frame pixel into the memory twice, first 
after short integration and then after long integration. The 
wide dynamic range operation allows the intra-scene dynamic 
range of images to be extended by combining the image taken 
with a short exposure time with the image taken with a long 
exposure time. A freeze-frame pixel is based on voltage 
sharing between the photodetector PD and the analog memory. 
Thus, with wide dynamic range operation, the resulting voltage 
in the memory may be a linear superposition of the two signals 
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representing a bright and a dark image after two operations of 
sampling. 

DESCRIPTION OF DRAS7INGS 

These and other features and advantages of the 
invention will become more apparent upon reading the following 
detailed description and upon reference to the accompanying 
drawings . 

Figure 1 illustrates one example of a freeze-frame 
pixel that may be used to obtain samples according to the 
present invention. 

Figure 2 illustrates sampling without using the wide 
dynamic range process according to one embodiment of the 
present invention. 

Figure 3 illustrates sampling using the wide dynamic 
range process according to one embodiment of the present 
invention. 

Figure 4 illustrates an idealized transfer curve 
which is achievable using the present invention. 

DETAILED DESCRIPTION 

A freeze-frame pixel 100 is shown in Figure 1 and 
comprises a photodetector PD with capacitance Cl^ an analog 
memory C2, a source follower transistor SF, switches S1-S3, 
and a row select switch RowSel. The photodetector PD with 
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capacitance CI is connected to a reset voltage Vrst through the 
switch SI. The analog memory C2 is connected to the reset 
voltage Vrst through switch S3. The photodetector PD with 
capacitance CI is connected to the analog memory C2 through 
the switch S2. The pixel structure 100 allows simultaneous 
photo-detection and readout of data stored in the pixel memory 
during the previous frame. 

The typical sequence of operations (without WiDyR) 
functions 200 is illustrated graphically in Figure 2. The 
switches 31 and S2 are enabled by active low pulses 205, 210, 
respectively. The analog memory C2 is reset during a previous 
readout time through switch S3. To start an exposure 215, the 
photodetector PD is reset through SI at the first low pulse in 
pulse train 205. To complete the integration 220 and transfer 
the data to the memory, the switch S2 is closed at the first 
low pulse in pulse train 210, thereby connecting the 
photodetector PD to the analog memory C2. The readout of the 
data from the pixel is done row by row. After the pixel 
signal is read 225, the analog memory is reset through S3. 
The reset level is also read out to subtract the pixel source 
follower offset voltage. 

The sequence of operations with the wide dynamic 
range process 300 is illustrated graphically in Figure 3. The 
switches SI and S2 are enabled by active low pulses 305, 310, 
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respectively. In wide dynamic range operation, the idea is to 
write the signal into the memory twice, first after short 
integration and then after long integration. The pixel 100 in 
Figure 1 is based on voltage sharing between the photodetector 
PD and the analog memory C2. Thus, after two operations of 
sampling, the resulted voltage in the memory will be a linear 
superposition of the two signals representing bright and dark 
image . 

The wide dynamic range operation process 300 is 
performed by resetting the analog memory capacitor C2 to Vrst 
through the switch S3. The analog memory capacitor C2 may 
also be reset during the previous readout. The process 300 
then resets the photodetector PD to Vrst through the switch SI- 
The photodetector PD then begins integration of a signal to 
create a photocharge Ql at time 315. After a short 
integration period tl, the signal is sampled to the analog 
memory capacitor C2 by enabling the switch S2 for a short 
time. The photodetector PD continues to integrate the signal 
for a long integration period t2 to create a photocharge Q2. 
Following the long integration period t2, the signal is again 
sampled to the analog memory capacitor C2 by enabling the 
switch S2. The signal is then read out 330 to all memories in 
the entire pixel array. 
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Because of the capacitor divider effect, after two 
samplings from the photodetector PD, the resulted signal 
voltage will be a combination of the signal accumulated during 
the short integration period tl and the long integration 
period t2 . For corresponding photocharges Ql and Q2 at the 
photodetector PD, respectively, the signal voltage will be 
equal to: 

Vsignal = Ql*C2 / { C1+C2 ) ^ + Q2/(C1+C2). 

The signal voltage Vsignai is a weighed sum of the 
photocharges Ql and QZ, so that the short integration is given 
a weight lesser by amount C2/(C1+C2). 

The option of having wide dynamic range is useful 
when a portion of the image after the long exposure is 
saturated. When the long exposure is saturated, the resulting 
response after summing the two signals will be the following: 

Vsignai = Q1*C2/(C1+C2)^ + Q5at/(C1+C2) ; 

where Qsat is the saturation charge for the 
photodetector PD, 

Because the memories hold the short integration 
signal, the overlap of the long integration and the frame 
readout are no longer possible. However, this is not a 
problem for a pixel with a synchronous shutter. Typically the 
shutter is needed for making very short snaps, at least 10 
times shorter than the frame time. Then the relative increase 
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of frame 'time including the exposure will not be substantially 
lower than the frame rate of the image sensor. 

The graph 400 in Figure 4 illustrates the idealized 
transfer curve which is achievable using the present 
invention. The resulting slope for the short integration is 
different from the original short exposure slope because of 
the C2/(C1+C2) factor. 

However, one of the problems with the current pixel 
is that the saturation voltage for photodiodes, approximately 
OV, is different from the pixel saturation voltage (-0.7 V for 
nMOS source follower SF transistor) . Also, the analog memory 
capacitance C2 is only approximately 1/5 of the total 
capacitance of C1+C2. Therefore, the knee of the combined 
transfer curve is below the threshold of the source follower 
transistor SF and we do not see an improvement. Another 
problem can arise from the bulk charge. If there is a 
noticeable charge left in the pixel after saturation, then it 
can saturate the memory during the second sample and thus 
erase the signal stored in the analog memory C2 after short 
integration. 

These problems can be addressed to achieve the dual- 
slope wide dynamic range response. First, the source follower 
SF and rowselect RowSel MOSFETS can be changed to p-MOS type 
transistors. Second, if the signal-to-noise ration is not a 
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problem, ' the size of the memory capacitor C2 may be increased 
so that the knee of the combined transfer curve is above the 
threshold of the source follower transistor SF. Finally, 
using an antiblooming gate for the photodetector PD with 
potential artifact such as fixed pattern noise due to 
antiblooming threshold variation. 

The present invention may be used with other pixels 
that do not use the freezer-frame structures, such as a 
photogate, with charge transfer rather that voltage sharing. 
The capacity of the detector at saturation should not then 
exceed the capacity of the memory to avoid erasing of the 
signal kept in the analog memory C2 after short integration. 

Numerous variations and modifications of the 
invention will become readily apparent to those skilled in the 
art. Accordingly, the invention may be embodied in other 
specific forms without departing from its spirit or essential 
characteristics . 


